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1 Overview 

In this report, we revisit the work of Pilleboue et al. [ 2015 ], provid¬ 
ing a representation-theoretic derivation of the closed-form expres¬ 
sion for the expected value and variance in homogeneous Monte 
Carlo integration. We show that the results obtained for the vari¬ 
ance estimation of Monte Carlo integration on the torus, the sphere, 
and Euclidean space can be formulated as specific instances of a 
more general theory. We review the related representation theory 
and show how it can be used to derive a closed-form solution. 

2 Problem Statmement 

We begin by reviewing some basic concepts from Monte Carlo inte¬ 
gration. Next, we present a formal definition of homogeneity. And 
finally, we formulate the generalized problem statement. 

Monte Carlo Integration 

Definition Given a domain Q and given two (complex-valued) 
functions F,G : Q ^ C, the dot-product of the functions is the 
integral of the product of F with the complex conjugate of G: 

{F, G)= jF{x) ■ Ax. 
n 

Definition Given a domain fl and given S' = {si,-- - ,SAr} € 
the Monte Carlo estimate of the integral of a function F •. Cl ^ C 
is obtained by averaging the values of F at the N positions: 

1 ^ 

MC{F,S) 

i = l 

Treating S as the average of delta functions, centered at {si}: 

S{x) = 

i=l 

the Monte Carlo estimate becomes the dot-product of F and S: 
MC{F, S) = (F, S). 

Definition Given a domain Cl and a positive integer N, a sampling 
pattern is a function V : Cl^ R over the set of all A-tuples of 
points in Cl, satisfying: 

fv{S)dS = \Cl\ and V{S)>0, VSeU^, 
n" 

where |U| is the measure of Cl. 

Definition Given a sampling pattern V and a function F : Cl ^ 
C, the expected value of the integral of F and the variance in the 
estimate of the integral are given by: 

Ev[{F,S)]:= f {F,S)-P{S)AS 
Varp((F,S)) := Ep[|KF,S)f] - ||EpKF, S)]|^ 


Homogeneity 

In order to make the problem of estimating the variance in Monte 
Carlo integration tractable, we restrict ourselves to sampling pat¬ 
terns that are homogeneous. To make this formal, we first define a 
notion of a group action. 

Definition We say that a group, T, acts on Cl if each element 7 £ T 
defines a maps 7 : U —^ U the preserves the measure on Cl. 

Notation Given a group action of T on Cl, given F ■. Cl ^ C, and 
given 7 G r, we denote by 7(T’) : G —^ C the function obtained 
by applying the inverse of 7 to the argument of F: 

[7(F)](2;) :=F(j~^(x)). 

Here, inversion is required so that (7 o y)(F) = 7(7(T’)) for all 

7,7 G r. 

Remark Since the map 'y ■. Cl ^ Cl preserves the measure, the 
associated map on the space of functions is unitary. That is, for any 
functions U, G : G —)■ C we have: 

(F,G) = (7(U),7(G)), V7Gr. 

Definition Given a group action of T on Cl, we say that a sampling 
pattern P : Cl^ —^ R is homogeneous with respect to T if the prob¬ 
ability of choosing a sampling pattern is the same as the probability 
of choosing any of its transformations by the group elements: 

P{S) = P{^{S)), Vyer. 

(Note that we can either think of 7(5) as the sampling pattern ob¬ 
tained by transforming the sample positions, Si i-)- 7(si), or as the 
transform of the sum of delta functions - the two definitions are 
consistent.) 

Remark If the group T is compact, one can always transform an 
initial sampling pattern Po into a homogeneous sampling pattern P 
by averaging over the group elements: 

P{S) :=^|po( 7 (s)) d 7 . 
r 

Remark It is common to use the term homogeneous to refer to 
invariance to translation and the term isotropic to refer to invari¬ 
ance to rotations. As the general theory we present will not distin¬ 
guish between the group actions, we will use the term homogeneous 
throughout. 

Problem Statement 

Thinking of the space of functions as a complex inner-product 
space, thinking of a sampling pattern as a real-valued function on 
this vector space, and using the fact that computing the Monte Carlo 
integral amounts to taking the dot-product of the integrand with the 
average of delta functions, we can view the problem of estimating 
variance in Monte Carlo integration as an instance of the following, 
more general, algebraic problem: 



Assume we are given a complex inner-product space {V, {■, •)), a 
group r acting on V, and a homogeneous function P : F ^ R. 
Then, given w € V, compute the expected value and variance of 
the dot-product of w with the vectors v € V: 

E73[{w,v)] = J{w,v)-'P{v) dw 

V 

Varp((w,v)) = Ep[||{u;,v)f] - ||Ep[{w, v)]||^ . 


The advantage of formulating the problem in this manner is that it 
makes it easier to leverage representation theory to find a solution. 
To this end, we review some basic concepts from representation the¬ 
ory in the next section, as well as derive two lemmas describing how 
the average of the inner-products of vectors behave as we transform 
one of the arguments by the elements of the group. Using these, 
we present our closed-form expression for the expected value and 
variance, given in terms of the Fourier coefficients of the integrand 
F and the sampling patterns S, in Section 4. 

3 Representation Theory 

The study of how the Fourier coefficients of a signal change as it 
is transformed by the elements of a group is best expressed in the 
language of representation theory. We review some basic concepts 
from this theory, before deriving the lemmas that lead to a closed- 
form expression for the expected value and variance of the Monte 
Carlo integral. 

In what follows, we will assume a compact (closed and bounded) 
Lie group F. 

Definition Given a complex inner-product space (U, (•,•)), we say 
that the (p, V) is a representation ofV if p is a group homomor¬ 
phism from F into the group of unitary transformations on V. That 
is: 

p(7 0 7) = p(7) op(7), V7,7er. 

Notation Given a representation (p, V), a group element 7 £ F, 
and a vector v £ V, we will write: 

7(w) := P(7)(w)- 

Definition Given a vector space V, the trivial representation is the 
map p sending every group element to the identity: 

p( 7 ) = Id., Vyer. 

Definition Given a representation (p, V) and a subspace W C V, 
we say that fU is a sub-representation if 7 ( 10 ) £ W for alf w £ fU 
and alf 7 £ F. 

Definition We say that (p, V) is an irreducible representation if 
the only sub-representations are lU = {0} and W = V. 

Remark Since any subspace of a trivial representation is a sub¬ 
representation (as the identity maps all vectors to themselves), a triv¬ 
ial representation is irreducible if and only if it is one-dimensional. 

Given a representation (p, V), Maschke’s Theorem [Serre 1977; 
Fulton and Harris 1991] tells us that we can decompose V as the 
direct sum of finite-dimensional, irreducible representations: 

U = 01 /^ 
aga 

with and perpendicular whenever X f X. 

Choosing an orthonormal basis {bj,, • • • , } for each allows 

us to define a Fourier transform: 


Definition Given a vector v £ V, and indices A £ A and m £ 
[1, • • • , ma], the (A, m)-th Fourier coefficient of v, denoted vf‘, is 
the coefficient of v corresponding to the basis vector 6 ™: 

v\ ■■= (v,bx ). 

Remark Since the basis defining the Fourier coefficients is or¬ 
thonormal, we can write the inner product of two functions v,w £ 
V in terms of these coefficients as: 

"A 

(v,w) = ^ ^ Fr • 

XGA m=l 

Lemma 3.1. Given an irreducible representation (p, V) of a group 
F, for any x,y,v,w £ V, we have: 

1 f - 1 - 

JJn{x),y) ■ {jiv),w) d 7 = ^ • {x,v) ■ {y,w). 

Corollary 3.2. In particular, letting { 6 ^, • • • ,b"} be an orthonor¬ 
mal basis for V, taking y — F and w = bf and fixing x = v, the 
above statement becomes: 

That is, the Fourier coefficients of 'y{v), thought of as complex¬ 
valued functions on F, are orthogonal and the magnitude is inde¬ 
pendent of which Fourier coefficient we are considering. 

Proof Fixing y,w £ V, let : U x U —>■ C be the map: 


By,,_,{x,v) = jja{x),y) ■ ( 7 (v),w) dj. 

It is not hard to show that this map is linear in the first argument, 
conjugate-linear in the second, and F-equivariant. (That is, for 
any 7 £ r we have (7(*)>7(2/)) = B„^^{x,y)). Thus, by 
Schur’s Lemma [Serre 1977; Fulton and Harris 1991], By,™ is a 
scalar multiple of the inner-product on V : 

By_n,ix,v) = Xy,,n ■ {X,V). 

Noting that By^Tj,{x, v) = Bx,v{y, w), it follows that: 

By,^{x,v) = X- {x,v) ■ {y,w), 

for some constant A £ C that is independent of v and w. 

Thus, we are left with the problem of determining A. As it is in¬ 
dependent of X, y, V, and w, it suffices to determine the value 
Bv^v{v, v) for some u 7 ^ 0. More generally, letting {b ^,..., b"} 
be an orthonormal basis we can get an expression for A in terms of 
the integrated square norm of the trace of p( 7 ): 

^ l|Tr(p(7))||^ d7 = 

n 

i = l 

= dim(U) ■ A. 

Since the trace is the character of the representation, it follows 
by the orthogonality of characters [Serre 1977; Fulton and Harris 
1991] that /r ||Tr(p( 7 ))||^ dy = |r|, giving A = |r|/dim(V'). 

Thus, as desired, we get: 

1 f - 1 - 

|p| J^{7{x),y) ■ { 7 iv),w) dy = • {x,v) ■ {y,w). 

□ 


^ ( 7 ( 6 '), 


2,7 = 1 


dy 



Lemma 3.3. Leveraging Schur’s Lemma in a similar manner, it 
follows that if (pi, Vf) and (p2, V2) are two irreducible represen¬ 
tations that are not isomorphic, then for any , wi G Vi and 
V 2 ,W 2 € V 2 : 


j (7(111), Wi) • (7(112), W)) d7 = 0. 


4 Variance Estimation 

Using the above theory, we are now prepared to estimate the vari¬ 
ance in Monte Carlo integration. We begin by presenting a general 
expression for the expected value and variance and then consider 
the specific cases of the torus, the sphere, and Euclidean space. 

4.1 General Framework 

We assume that we are given a representation (p, V) of a compact 
group r, a homogeneous function P : U —>■ R (i.e. Viv) = 
'P{'y{v)) for all II G U and all 7 G F), and a vector w £ V. Our 
goal is to express the expected value and variance of the dot-product 
of w with the vectors v G U: 

E 73 [(w,v)] = J{w,v) ■'P{v) Av 

V 

Var 7 :.((w,v)) = Er>[||(w,v)||^] - ||Er>[(w, v)]||^ . 


Since is a unit vector on which 7 acts as the identity, we have: 

y AgAm=l 



Using Lemmas 3.1 and 3.3, the facts that U° is orthogonal and not 
isomorphic to for all A 7 ^ 0, and that dim(U°) = 1, we have: 


’■‘x _ 

Ep[(w,v)] = Wx- {v,bl) ■ ( 6 r,feo) • ^(«) dw 

AeA m=l y 

= J-Vq ■ Viv) du 


wl ■ Jvq ■ Viv) dll. 


That is, the expected value of the dot-product is the trivial Fourier 
coefficient of w times the complex conjugate of the expected value 
of the trivial Fourier coefficient of the vectors v G U: 


Et:>[(w,v)] = Wo • E-p[vl]. 


( 1 ) 


The Variance 


In deriving the closed form expression for the expected value and 
variance, we will assume that the decomposition of V into irre¬ 
ducible representations {U^}a 6 A contains the trivial representa¬ 
tion. (If it does not, we can take the direct sum of V with a one¬ 
dimensional space on which F acts trivially.) We will denote this 
one-dimensional representation as U° and let be a unit-vector 
spanning this space (with 7 ( 60 ) = for 7 e r)- 

Finally, for simplicity, we will assume that the irreducible represen¬ 
tations occur without multiplicity. That is, if A 7 ^ A then and 
are not isomorphic, for all A, A G A. 


Using Equation (1), we can express the variance of the dot-product 
of w with the vectors v G U as: 

Varp((w,v)) = E7 :>[||(w,v)||^] - ||wj||^ • ||E7 :>[vJ] 11^ 

and we are left with the problem of computing Ep [||(w, v) ||^]. 


Expressing the dot-product in terms of the Fourier coefficients 
gives: 


(w,v)|| = 


17 


I] I] « 

A^A m=l 


X 


■ P{v) du 


The Expected Value 

Using the Fourier coefficients, we can express expected value of the 
dot-product of w with the vectors v G U as: 

/ "X 

-vT dw- 

Y AGAm —1 


Using the homogeneity of V, the expected value computed by in¬ 
tegrating over V is the same as the expected value computed by 
integrating over 7 (U). In particular, we can express the expected 
value as the average: 


Ep[(w,v)] = 


|r| 


f f dw dy 

7 ^ -/T.A AGAm=l 


r^(v) 

^A 


= M / / X] ^ 

rv 

= [ [ ('>'(w),&r)d 7 ) ■V{v)dv. 

'^Y AeAm-1 \ r / 


p ^A ’^A _ 

= J '^'^Wx -wf -vy ■p{v)dv. 


V A.AgA' 


As with the expected value, homogeneity implies that we can aver¬ 
age the integrals over all yiV), giving: 


Ep[||(w,v) 


7 ? 


Wx 


A,AeA”i=l™=l 


|f| I J 7 (w)a • 7 (w)a d7 I ■ P{v) du. 


Using the fact that y(v)x = {'y{v), Vf) in conjunction with Lem¬ 
mas 3.1 and 3.3 and letting tta : U —>■ be the projection from 

V onto the irreducible representation V^, the summation simplifies 
to: 

Er>[||(tu,v)||"] = du 

AGAm=l ^ ’ 


-E 

A€A 


||7rA(w)||^ ■ Ep[|| 7 rA(v)f] 
dim(U^) 




This gives a closed-form expression for the variance as: 



Note that hy taking the summation over all irreducible representa¬ 
tions except for the trivial one we subtract off the square-norm of 
the expected value. 

4.2 The Torus 

In this case, the domain of integration and the group of motions are 
both the d-dimensional torus, SI = F = [ 0 , 27r)‘*, and the represen¬ 
tation is defined on the space of complex-valued functions on the 
torus, V — F/^(S2, C), with an element 7 € F acting on a function 
by translation: 

[7(J^)](P) := F{p-y). 

The irreducible representations are all one-dimensional (since 
the group is commutative) and are indexed by points on the d- 
dimensional integer lattice, A = Z”*. Specifically, the space 
is spanned by a complex exponential with frequency A € Z^*: 

r gi(pA) ) 

1 / -Span|h,(p) = ^^|. 

Thus, Equation (1) gives the expected value of the integral of F as 
the product of the DC component of F times the complex conju¬ 
gate of the expected value of the DC component of S. As we are 
considering Monte Carlo integration, the elements of S are all the 
average of N delta-functions, so that: 

Ev[{F,S}] = Jf{p) dp, 
n 

and the estimate is unbiased. 

From Equation (2) the variance in the estimate of the integral 
can be obtained by taking the power spectrum of F, multiplying 
(frequency-wise) by the expected power spectrum of S, and sum¬ 
ming over all non-zero frequencies: 

Varp(MC(F’,S))= ||Fx ||" ■ [||S;, H^] , 

AeZ‘i\{0} 

where Fi is the l-th Fourier coefficient of F. 

4.3 The Sphere 

In this case, the domain of integration is the 2-sphere, Q = S^, 
the group of motions is the group of rotations in 3D, F = SO{3), 
and the representation is defined on the space of complex-valued 
functions on the sphere, V = C), with an element 7 € F 

acting on a function by rotation: 

[7(-P’)](j5) ■- Fi'r~\p)) ■ 

In this case, the irreducible representations are indexed by the non¬ 
negative integers, A = [0, • • • , 00 ), and the irreducible representa¬ 
tion is a (2A + 1)-dimensional space: 

1 /^ =Span{y;r^( 0 , 0 ),-. - 


As with the torus the integrator is unbiased, and the variance can 
be computed by summing, over each non-zero spherical frequency, 
the product of the power of F and the expected power of S in that 
frequency, divided by the dimension of the frequency space: 

^ E E E.’fiisnr] 

Varp(MC(F, S)) = E ^ -27TT-’ 

i=i ^ 

where F™ is the {I, m)-th spherical harmonic coefficient of F. 

4.4 Euclidean Space 

In this case, the domain of integration is d-dimensional Euclidean 
space, D = R'*, the group is the group of Euclidean motions, 
F = SE(d) = R'* X SO(d), and the representation is defined 
on the space of complex-valued functions on Euclidean space, 
V = L^(fl,C), with an element j — (T,a) € F acting on a 
function by a combination of translation and rotation: 

[ 7 (F)](p) ■- F (a~\p - t)) . 

Unfortunately, the analysis in Section 3 does not apply to this con¬ 
text because we assumed that the group is compact. None-the-less, 
we can formally carry over the results, replacing the notion of “di¬ 
mension” with the the “size” of the irreducible representations. 

In this case, the irreducible representations are indexed by the non¬ 
negative real numbers, A = R-° [Vilenkin 1978] and the space 
is the “span” of complex exponentials whose frequency has norm 
A: 

= Span,^!^;, {&a(p) = j . 

As above, the integrator is unbiased and, using the fact that the size 
of the A-th irreducible representation is the size of of the (d — 1)- 
dimensional sphere with radius A, we get: 

Varp(MC(F,S)) = 

f \\F,fdq ■ f Ep[||S,f] dq 

kNA kNA 

Jo A^-i.|S'*-i| 

-IIFof •Ep[||So||"], 
where Fp is the p-th Fourier coefficient of F. 
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with Yi^{9, (jf) the spherical harmonic of frequency I and index m. 




